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DETAILED ACTION 

Continued Examination Under 37 CFR 1.114 

1 . A request for continued examination under 37 CFR 1.114, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR 1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 
February 6, 2008 has been entered. 



Response to Amendment 

2. This Office Action is in response to Applicant's communication filed February 6, 
2008. The Applicant's remarks and amendments to the claims and/or the specification 
were considered with the results that follow. Claims 1 , 3-4, 6, and 8-1 1 have been 
amended. Claims 2, 7, and 13-18 have been cancelled. Claim 5 has been previously 
cancelled. Claim 12 has been previously presented. Claims 19-32 have been newly 
added. As a result, claims 1, 3-4, 6, 8-12, and 19-32 are now pending in this application. 



Claim Rejections - 35 USC § 101 

3. The rejections to claims 1-4 and 6-18 under 35 USC § 101 have been withdrawn 
due to the amendment filed February 6, 2008. 
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Claim Rejections - 35 USC §112 

4. The following is a quotation of the second paragraph of 35 U.S.C. 1 12: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

5. Claims 3, 23-24, and 31-32 are rejected under 35 U.S.C. 1 1 2, second 
paragraph, as being indefinite for failing to particularly point out and distinctly claim the 
subject matter which applicant regards as the invention. 

Claim 3 recites the limitation "the same program property object". There is 
insufficient antecedent basis for this limitation in the claim. 

Claims 23 and 31 recite the limitation "the property". There is insufficient 
antecedent basis for this limitation in the claim. 

Claims 31 and 32 recite the limitation "the property editor tool". There is 
insufficient antecedent basis for this limitation in the claim. 

Regarding claims 24 and 32 , the phrase "to be edited" renders the claims 
indefinite because the claims include elements not actually disclosed (those 
encompassed by "to be edited"), thereby rendering the scope of the claims 
unascertainable. See MPEP § 2173.05(d). 
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Claim Rejections - 35 USC § 103 

6. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in section 
102 of this title, if the differences between the subject matter sought to be patented and the prior art are such that the 
subject matter as a whole would have been obvious at the time the im ention was made to a person ha\ ing ordinary skill 
in the art to which said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 

7. Claims 1, 3-4, 6, 8-12, and 19-22 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Shimizu et al. (US Patent 6,374,271 B1), and in view of Newman et 
al. (US Patent 6,154, 600), and in further view of Rutledge (USPA Pub 2004/0054627 
A1). 

As per claim 1 . Shimizu discloses, "providing a collection basket tool interface for 
configuring program properties, the collection basket tool interface comprising a 
program basket workspace" as [The hypermedia authoring system... provides a 
display for creating a presentation outline in the form of Bento-boxes. Each 
Bento-box includes a layout workspace in which spacer objects may be placed. 
Spatial and temporal parameters may also be specified corresponding to each 
spacer object. The spacer objects may be linked to cards in the card database 
and an indication of a link relationship with the goals outline is also provided 
(column 1, line 66 - column 2, line 6); Fig. 13]. Furthermore, Shimizu discloses, "and 
an auxiliary workspace" as [Fig. 8]. Furthermore, Shimizu discloses, "the program 
basket workspace comprises a plurality of program slots" as [The hypermedia 
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authoring system... provides a display for creating a presentation outline in the 
form of Bento-boxes. Each Bento-box includes a layout workspace in which 
spacer objects may be placed. Spatial and temporal parameters may also be 
specified corresponding to each spacer object. The spacer objects may be linked 
to cards in the card database and an indication of a link relationship with the 
goals outline is also provided (column 1, line 66 - column 2, line 6); Fig. 13]. 
Furthermore, Shimizu discloses, "generating at least one program and one or more 
program properties associated with the imported media" as [the hypermedia authoring 
system provides a display that permits the author to link each of the slot types of 
an instantiated document prototype with cards in a card database. Cards 
may... be created from scratch by the author or imported from external sources 
and linked with the instantiated document prototype (column 1, lines 60-65); The 
related goals outline nodes are goals outline nodes that are linked to cards which 
are also linked to spacer objects in the Bento-box 800 (column 7, lines 48-50); The 
cards in the card database 106 are information elements (called points) on which 
the document being authored is based... the cards contain the actual hypermedia 
information such as video, sound or text that make up the document. The 
contents of the points may be appropriated from either external sources or 
created from scratch by the author (column 3, lines 38-44); Fig. 8 and Fig. 13]. 
Furthermore, Shimizu discloses, "each program is a program object" as [The cards in 
the card database 106 are information elements (called points) on which the 
document being authored is based... the cards contain the actual hypermedia 
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information such as video, sound or text that make up the document. The 
contents of the points may be appropriated from either external sources or 
created from scratch by the author (column 3, lines 38-44); Bento-box (column 7, 
line 36); The Bento-boxes may be linked to each other in a stack for a sequential 
slide presentation (column 2, lines 12-13)]. Furthermore, Shimizu discloses, "each 
program property is an object" as [The spacer objects 706-718 (column 7, line 35); 
related goals outline nodes (column 7, lines 46-48); Fig. 13]. Furthermore, Shimizu 
discloses, "each program object references at least one program property object" as 
[The related goals outline nodes are goals outline nodes that are linked to cards 
which are also linked to spacer objects in the Bento-box 800 (column 7, lines 48- 
50); The cards in the card database 106 are information elements (called points) 
on which the document being authored is based... the cards contain the actual 
hypermedia information such as video, sound or text that make up the document. 
The contents of the points may be appropriated from either external sources or 
created from scratch by the author (column 3, lines 38-44); Fig. 8 and Fig. 13]. 
Furthermore, Shimizu discloses, "creating a program element to represent each 
generated program, wherein each program element is displayed within separate 
program slots of the program basket workspace" as [The hypermedia authoring 
system... provides a display for creating a presentation outline in the form of 
Bento-boxes. Each Bento-box includes a layout workspace in which spacer 
objects may be placed. Spatial and temporal parameters may also be specified 
corresponding to each spacer object. The spacer objects may be linked to cards 
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in the card database and an indication of a link relationship with the goals outline 
is also provided (column 1, line 66 - column 2, line 6); The cards in the card 
database 106 are information elements (called points) on which the document 
being authored is based... the cards contain the actual hypermedia information 
such as video, sound or text that make up the document. The contents of the 
points may be appropriated from either external sources or created from scratch 
by the author (column 3, lines 38-44); Bento-box 800 (which may be a card) 
(column 7, lines 36-37); The Bento-boxes may be linked to each other in a stack 
for a sequential slide presentation (column 2, lines 12-13); The cutting board 1508 
displays the presentation outline. The Bento-boxes 1510 and 1512 are shown on 
the cutting board 1 508 (column 9, lines 39-42); Fig. 13 and Fig. 21]. Finally, Shimizu 
discloses, "editing the programs and properties based on user input obtained through 
the collection basket tool interface" as [The hypermedia authoring system... provides 
a display for creating a presentation outline in the form of Bento-boxes. Each 
Bento-box includes a layout workspace in which spacer objects may be placed. 
Spatial and temporal parameters may also be specified corresponding to each 
spacer object. The spacer objects may be linked to cards in the card database 
and an indication of a link relationship with the goals outline is also provided 
(column 1, line 66 - column 2, line 6); Fig. 13]. 

Shimizu does not explicitly teach, "a computer-implemented method for 
processing media and configuring program properties associated with the media for a 
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digital document" and "the auxiliary workspace comprises at least one media 
configuration tool". 

However, Newman discloses, "a computer-implemented method for processing 
media and configuring program properties associated with the media for a digital 
document" as [The present invention provides a complete, standalone, economical 
system that enables consumers to create, manipulate, edit, view and output 
hypermedia (column 17, lines 60-63); 7/ie term hypermedia refers to the 
integration of text, graphics, sound, video, and other data, or any combination 
into a primarily associative system for information presentation, storage and 
retrieval. For example, hypermedia includes motion pictures, music, animation 
and photographs (column 5, lines 47-50); FIG. 12 illustrates an embodiment of a 
graphics GUI 490. The graphics GUI 490 includes a graphics tab 492 having a 
scroll bar 494 and a plurality of icons 496 representing various graphics overlays, 
such as color, titles, and text on color. The graphics GUI 490 similarly includes a 
display window 408 to display an image for graphical editing. The graphics GUI 
490 also includes an image edit window 498 having a plurality of image editing 
tool buttons 500, such as a line tool, a box tool, a text tool, cut, copy and paste, 
about the periphery of the image edit window 498... Moreover, the graphics GUI 
490 includes a features portion 502. The features portion 502 includes a name box 
504, wherein the consumer may select a name to identify the edited graphic and a 
plurality of tabs 506, each tab having property selections for some of the image 
editing tool buttons 500. For example, a color tab 508 includes selection boxes 
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510 to select color features of lines, fills and shadows. Lastly, the features portion 
502 includes a pair of slider bars 512, each having a slider 514, for the selection 
of color gradients. Operation of the graphics editor is similar to conventional 
graphics editors, such as MacPaint and Paintbrush (column 16, lines 21-44); Fig. 
12]. Finally, Newman discloses, "the auxiliary workspace comprises at least one media 
configuration tool" as [The present invention provides a complete, standalone, 
economical system that enables consumers to create, manipulate, edit, view and 
output hypermedia (column 17, lines 60-63); The term hypermedia refers to the 
integration of text, graphics, sound, video, and other data, or any combination 
into a primarily associative system for information presentation, storage and 
retrieval. For example, hypermedia includes motion pictures, music, animation 
and photographs (column 5, lines 47-50); FIG. 12 illustrates an embodiment of a 
graphics GUI 490. The graphics GUI 490 includes a graphics tab 492 having a 
scroll bar 494 and a plurality of icons 496 representing various graphics overlays, 
such as color, titles, and text on color. The graphics GUI 490 similarly includes a 
display window 408 to display an image for graphical editing. The graphics GUI 
490 also includes an image edit window 498 having a plurality of image editing 
tool buttons 500, such as a line tool, a box tool, a text tool, cut, copy and paste, 
about the periphery of the image edit window 498... Moreover, the graphics GUI 
490 includes a features portion 502. The features portion 502 includes a name box 
504, wherein the consumer may select a name to identify the edited graphic and a 
plurality of tabs 506, each tab having property selections for some of the image 
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editing tool buttons 500. For example, a color tab 508 includes selection boxes 
510 to select color features of lines, fills and shadows. Lastly, the features portion 
502 includes a pair of slider bars 512, each having a slider 514, for the selection 
of color gradients. Operation of the graphics editor is similar to conventional 
graphics editors, such as MacPaint and Paintbrush (column 16, lines 21-44); Fig. 
12]. 

Shimizu and Newman are analogous art because they both teach a method for 
configuring properties for a digital document. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to have combined the teachings of Newman with the teachings of 
Shimizu because Newman's teachings provide Shimizu's method with a complete, 
standalone, economical system that enables consumers to create, manipulate, edit, 
view and output hypermedia [column 17, lines 60-63]. For example, the graphics GUI 
allows a user to edit graphics included in a hypermedia [column 16, lines 21-44]. 

Furthermore, Shimizu and Newman both do not explicitly teach, "receiving user 
input to select the media to import using the media configuration tool" and "importing the 
media selected by the user". 

However, Rutledge discloses, "receiving user input to select the media to import 
using the media configuration tool" as [The media ID software has a sophisticated 
graphical-user-interface (or GUI) that allows the user to navigate through the 
locally stored media IDs, initiate complicated search queries for local and remote 
media and media IDs, and retrieve articles of media and media IDs... the media ID 
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and the media ID software contain the necessary information required to transfer 
the entire text and graphics of the original article of media between the web 
server and the media ID software 1080... when the user clicks on a media ID such 
as the one located at 1070 in FIG. 22, the entire text and graphics of the media 
article 1068 will be transferred along with the media ID 1070 to the media ID 
software 1080 (page 27, paragraph [0275], lines 1-24); The media ID software 
program manages media IDs and their content, provides advanced query tools for 
searching and sorting of media ID content, manages the download and transfer of 
media IDs and associated electronic documents, and includes screens, windows 
or other facilities for quick and easy previewing of electronic documents (page 
31, paragraph [0319], lines 1-7); Fig. 33, Fig. 37 and Fig. 39-41]. Finally, Rutledge 
discloses, "importing the media selected by the user" as [The media ID software has a 
sophisticated graphical-user-interface (or GUI) that allows the user to navigate 
through the locally stored media IDs, initiate complicated search queries for local 
and remote media and media IDs, and retrieve articles of media and media IDs... 
the media ID and the media ID software contain the necessary information 
required to transfer the entire text and graphics of the original article of media 
between the web server and the media ID software 1080... when the user clicks on 
a media ID such as the one located at 1070 in FIG. 22, the entire text and graphics 
of the media article 1068 will be transferred along with the media ID 1070 to the 
media ID software 1080 (page 27, paragraph [0275], lines 1-24); The media ID 
software program manages media IDs and their content, provides advanced 
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query tools for searching and sorting of media ID content, manages the download 
and transfer of media IDs and associated electronic documents, and includes 
screens, windows or other facilities for quick and easy previewing of electronic 
documents (page 31, paragraph [0319], lines 1-7); Fig. 33, Fig. 37 and Fig. 39-41]. 

Shimizu, Newman, and Rutledge are analogous art because all three teach a 
method of configuring hypermedia. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to have combined the teachings of Rutledge with the combined 
teachings of Shimizu and Newman because Rutledge's teachings provide the 
combination of Shimizu's and Newman's method with sophisticated media search tools 
to facilitate the media search process [(page 36, paragraph [0369], lines 1-2); Fig. 39 
-Fig. 41]. 

As per claim 3 , Shimizu discloses, "a first program object and a second program 
object reference the same program property object" as [the caption spacer object 710 
is highlighted as indicated by the dotted box 802 and the corresponding card C is 
highlighted as indicated by the dotted box 803. If a spacer object 706-718 is linked 
to more than one card, then all the cards linked to the selected spacer object are 
highlighted (column 7, lines 40-45); Fig. 13]. 
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As per claim 4 , Shimizu discloses, "a first program object and a second program 
object reference duplicate program property objects" as [the caption spacer object 
710 is highlighted as indicated by the dotted box 802 and the corresponding card 
C is highlighted as indicated by the dotted box 803. If a spacer object 706-718 is 
linked to more than one card, then all the cards linked to the selected spacer 
object are highlighted (column 7, lines 40-45); Fig. 13]. 

As per claim 6 , Shimizu discloses, "exporting the program from the program 
basket workspace to a stage channel of the digital document" as [The hypermedia 
authoring system... provides a display for creating a presentation outline in the 
form of Bento-boxes. Each Bento-box includes a layout workspace in which 
spacer objects may be placed. Spatial and temporal parameters may also be 
specified corresponding to each spacer object. The spacer objects may be linked 
to cards in the card database and an indication of a link relationship with the 
goals outline is also provided (column 1, line 66 - column 2, line 6); the 
hypermedia authoring system provides a display that permits the author to link 
each of the slot types of an instantiated document prototype with the cards in a 
card database. Cards may... be created from scratch by the author or imported 
from external sources and linked with the instantiated document prototype 
(column 1, lines 63-65); Bento-box 800 (which may be a card); The cutting board 
1508 displays the presentation outline. The Bento-boxes 1510 and 1512 are 
shown on the cutting board 1508 (column 9, lines 39-42); Fig. 13 and Fig. 21]. 
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As per claim 8 , Shimizu discloses, "implementing the collection basket tool 
interface as a graphic user interface, wherein the program basket workspace is 
implemented as a first graphical user interface window" as [The hypermedia authoring 
system... provides a display for creating a presentation outline in the form of 
Bento-boxes. Each Bento-box includes a layout workspace in which spacer 
objects may be placed. Spatial and temporal parameters may also be specified 
corresponding to each spacer object. The spacer objects may be linked to cards 
in the card database and an indication of a link relationship with the goals outline 
is also provided (column 1, line 66 - column 2, line 6); Fig. 13]. Furthermore, 
Shimizu discloses, "the auxiliary workspace is implemented as a second graphical user 
interface window" as [The goals outline processor 608 processes the goals outline 
by displaying a goals outline display 400 on the display device 605 and generates 
the goals outline 102 based on user inputs received through the keyboard/mouse 
609... Fig. 8 shows the goals outline display 400 that includes a tree view area 402, 
a card link area 404, and a document prototype legend area 406. The tree view 402 
displays the tree view 408 of the goals outline 202. Each of the nodes 206-214 are 
represented by square boxes that are connected to a respective icon such as 
icon 432 corresponding to node 206. Each of the icons 432, 436, 438, 440, and 460 
are coded, by color for example, based on the document prototype that is 
instantiated to correspond to the respective nodes 206-214. For example, the icon 
432 is colored blue as represented by the horizontal parallel lines; icon 438 is 
colored red as represented by the parallel vertical lines; and icon 440 is colored 
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green as represented by the parallel slanted lines. As shown in the legend area 
406, the blue color indicated in area 424 corresponds to a description document 
prototype; the green color indicated in area 426 corresponds to an argument 
prototype; and the red color indicated in area 428 corresponds to a narrative 
prototype (column 5, lines 44-65); Fig. 8]. 

As per claim 9 , Rutledge discloses, "providing the auxiliary workspace includes: 
providing a media search tool" as [The media ID software has a sophisticated 
graphical-user-interface (or GUI) that allows the user to navigate through the 
locally stored media IDs, initiate complicated search queries for local and remote 
media and media IDs, and retrieve articles of media and media IDs (page 27, lines 
1-5); The media ID software program... provides advanced query tools for 
searching and sorting of media ID content (page 31, paragraph [0319], lines 1-3); 
The media ID software contains sophisticated media and media ID search tools as 
well as sophisticated media and media ID filtering tools. A media ID search 
engine window 1622 in FIG. 39 provides powerful and flexible search capabilities. 
The media ID search engines window 1622 contains a search matrix 1624 that the 
user can utilize to design and execute searches for media IDs and associated 
media (page 36, paragraph [0369], lines 1-8); Fig. 39 and Fig. 41]. 
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As per claim 10 , Shimizu discloses, "providing the auxiliary workspace includes: 
providing a scene configuration tool, said scene configuration tool used to configure one 
or more scenes included in one or more programs" as [The presentation outline 
processor... provides support for the author to generate a presentation 
outline. ..FIG. 10 shows a layout workspace 700 where the author may generate a 
physical appearance of the document spatially as well as temporally by placing 
spacer objects in a spatial layout area 702 and spacer objects in a sound layout 
area 704. For example, the author may place visual spacer objects 706-712 and 
sound spacer objects 714, 716 and 718 as shown in FIG. 10. Each of the spacer 
objects may be time sequenced using a temporal view 810 of the layout 
workspace 700 as shown in FIG. 11. ..The spacer objects 706-718 in the layout 
workspace 700 are linked to corresponding cards by using a Bento-box 800 
(which may be a card) which include the layout workspace as shown in Fig. 13. A 
card link area 804 shows the cards that are linked to the corresponding spacer 
objects 706-71 8... In addition to the card link area 804, the Bento-Box 800 also 
includes a related goals outline area 806 that shows related goals outline nodes. 
The related goals outline nodes are goals outline nodes that are linked to cards 
which are also linked to spacer objects in the Bento-box 800.. .The Bento-box 800 
provides a method for linking the presentation outline to the cards in the card 
database 106 which indirectly also links the presentation outline 104 with the 
goals outline 102 as indicated by the related goals outline area 806 (column 7, 
lines 16-59); Fig. 10 -Fig. 13]. 
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As per claim 11 , Shimizu discloses, "providing the auxiliary workspace includes: 
providing a slide configuration tool, said slide configuration tool used to configure a slide 
show of programs" as [The Bento-boxes may be linked to each other in a stack for 
a sequential slide presentation (column 2, lines 12-13); Fig. 14 shows a stack of 
Bento-boxes 830, 840 and 850. Bento-box 830 titled Bento 1 is displayed first and 
then Bento-box 840 titled Bento 2 is displayed second and then Bento-box 850 
titled Bento 3 is displayed third... Bento-boxes 830, 840 and 850 are linked to each 
other in a stack to indicate a serial presentation of the information contained in 
each of the Bento-boxes 830, 840 and 850. A Bento-box stack may be given titles 
so that each of the Bento-box stacks may be referenced as a whole when linked 
to other Bento-boxes or Bento-box stacks. For example, FIG. 15 shows such a 
sequence of Bento-boxes slide #1 902, slide #2 904 and slide #3 906. These 
Bento-boxes 902-906 are arranged sequentially in a stack so that Bento-boxes 
902, 904 and 906 are presented in sequential order as a slideshow presentation 
(column 7, line 60 - column 8, line 7); Fig. 14 - Fig. 15]. 

As per claim 12 , Rutledge discloses, "the media search tool includes a media 
viewer to allow a user to preview a search result" as [The media ID software program 
manages media IDs and their content, provides advanced query tools for 
searching and sorting of media ID content, manages the download and transfer of 
media IDs and associated electronic documents, and includes screens, windows 
or other facilities for quick and easy previewing of electronic documents (page 
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31, paragraph [0319], lines 1-7); A media search results window 1632 shows the 
results from a media ID search executed from the media search engine 1622. In 
this example, three search results were returned in the media search results 
window 1632. The user of the media ID software can click on one or more of these 
search results to access the media ID associated with it and or the original article 
of media (page 36, paragraph [0370], lines 1-7); Fig. 33 and Fig. 39]. 

As per claim 19 , Newman discloses, "at least one of the property objects 
reference one or more methods" as [the storyboard GUI 440 includes a button panel 
458 having a plurality of buttons corresponding to a wide variety of editing 
functions for the storyboard 446, such as save, print, cut, copy and paste (column 
15, lines 29-32); Fig. 10]. 

As per claim 20 , Rutledge discloses, "providing a media filter to analyze the 
media before importing the media to ensure that the media's format is supported by the 
collection basket tool interface" as [The media ID software contains sophisticated 
media and media ID search tools as well as sophisticated media and media ID 
filtering tools (page 36, paragraph [0369], lines 1-3); The media ID software has a 
sophisticated graphical-user-interface (or GUI) that allows the user to navigate 
through the locally stored media IDs, initiate complicated search queries for local 
and remote media and media IDs, and retrieve articles of media and media IDs. 
This graphical-user-interface 1086 provides functionality for the user to accept 
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the default media ID organization structure or to configure a custom media ID 
organization structure... Each media ID has complete information about the media 
article such as publisher, date published, number of pages, media type, author, 
title, icon type, etc. In many cases the electronic media ID and the original media 
are stored together (the entire text, graphics, sound, video, etc) in the media ID 
software. In other embodiments, the media ID and the media ID software contain 
the necessary information required to transfer the entire text and graphics of the 
original article of media between the web server and the media ID software 1080. 
In one embodiment of the present invention, when the user clicks on a media ID 
such as the one located at 1070 in FIG. 22, the entire text and graphics of the 
media article 1068 will be transferred along with the media ID 1070 to the media ID 
software 1080 (page 27, paragraph [0275], lines 1-24); The media ID software 
program manages media IDs and their content, provides advanced query tools for 
searching and sorting of media ID content, manages the download and transfer of 
media IDs and associated electronic documents, and includes screens, windows 
or other facilities for quick and easy previewing of electronic documents (page 
31, paragraph [0319], lines 1-7); Fig. 33, Fig. 37, and Fig. 39-41]. 
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As per claim 21 , Shimizu discloses, "creating one or more property icons within 
each program slot displaying the program elements, wherein the property icons 
represent the program properties referenced by the program associated with the 
displayed program element" as [The hypermedia authoring system... provides a 
display for creating a presentation outline in the form of Bento-boxes. Each 
Bento-box includes a layout workspace in which spacer objects may be placed. 
Spatial and temporal parameters may also be specified corresponding to each 
spacer object. The spacer objects may be linked to cards in the card database 
and an indication of a link relationship with the goals outline is also provided 
(column 1, line 66 - column 2, line 6); Fig. 13]. Finally, Shimizu discloses, 
"configuring programs by manipulating program properties through actions performed 
on their associated property icons within the program basket workspace, wherein the 
actions are performed based on user input" as [The goals outline processor 608 
processes the goals outline by displaying a goals outline display 400 on the 
display device 605 and generates the goals outline 102 based on user inputs 
received through the keyboard/mouse 609. ..Fig. 8 shows the goals outline 
display 400 that includes a tree view area 402, a card link area 404, and a 
document prototype legend area 406. The tree view 402 displays the tree view 408 
of the goals outline 202. Each of the nodes 206-214 are represented by square 
boxes that are connected to a respective icon such as icon 432 corresponding to 
node 206. Each of the icons 432, 436, 438, 440, and 460 are coded, by color for 
example, based on the document prototype that is instantiated to correspond to 
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the respective nodes 206-214. For example, the icon 432 is colored blue as 
represented by the horizontal parallel lines; icon 438 is colored red as 
represented by the parallel vertical lines; and icon 440 is colored green as 
represented by the parallel slanted lines. As shown in the legend area 406, the 
blue color indicated in area 424 corresponds to a description document 
prototype; the green color indicated in area 426 corresponds to an argument 
prototype; and the red color indicated in area 428 corresponds to a narrative 
prototype (column 5, lines 44-65); Fig. 8]. 

As per claim 22 , Shimizu discloses, "the actions performed on the property icons 
comprise: deleting property icons" as [The inherit column 518 indicates whether the 
link type for each slot name is inherited from a higher level document prototype. 
Because document prototypes may be recursively defined (i.e., a document 
prototype being defined by other document prototypes), the link types of higher 
level document prototypes may either be applied to the lower level document 
prototypes such as indicated by symbol 514 corresponding to the Process slot 
name or be overwritten by the lower level document prototype as indicated by 
symbol 516 corresponding to the Historical slot name. Thus, the browser display 
500 provides the author complete flexibility in defining document prototypes and 
when used in conjunction with the goals outline display 400 as shown in Fig. 8, 
and each of the instantiated document prototypes may be linked to a card in the 
card database 106 (column 7, lines 1-15); Fig. 8; See 516 in Fig. 9]. Furthermore, 
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Shimizu discloses, "copying property icons from one program slot to another program 
slot" as [the caption spacer object 710 is highlighted as indicated by the dotted 
box 802 and the corresponding card C is highlighted as indicated by the dotted 
box 803. If a spacer object 706-718 is linked to more than one card, then all the 
cards linked to the selected spacer object are highlighted (column 7, lines 40-45); 
The inherit column 518 indicates whether the link type for each slot name is 
inherited from a higher level document prototype. Because document prototypes 
may be recursively defined (i.e., a document prototype being defined by other 
document prototypes), the link types of higher level document prototypes may 
either be applied to the lower level document prototypes such as indicated by 
symbol 514 corresponding to the Process slot name or be overwritten by the 
lower level document prototype as indicated by symbol 516 corresponding to the 
Historical slot name. Thus, the browser display 500 provides the author complete 
flexibility in defining document prototypes and when used in conjunction with the 
goals outline display 400 as shown in Fig. 8, and each of the instantiated 
document prototypes may be linked to a card in the card database 106 (column 7, 
lines 1-15); Fig. 8; See 514 in Fig. 9; Fig. 13]. Finally, Shimizu discloses, "moving 
property icons from one program slot to another program slot" as [the caption spacer 
object 710 is highlighted as indicated by the dotted box 802 and the 
corresponding card C is highlighted as indicated by the dotted box 803. If a 
spacer object 706-718 is linked to more than one card, then all the cards linked to 
the selected spacer object are highlighted (column 7, lines 40-45); The inherit 
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column 518 indicates whether the link type for each slot name is inherited from a 
higher level document prototype. Because document prototypes may be 
recursively defined (i.e., a document prototype being defined by other document 
prototypes), the link types of higher level document prototypes may either be 
applied to the lower level document prototypes such as indicated by symbol 514 
corresponding to the Process slot name or be overwritten by the lower level 
document prototype as indicated by symbol 516 corresponding to the Historical 
slot name. Thus, the browser display 500 provides the author complete flexibility 
in defining document prototypes and when used in conjunction with the goals 
outline display 400 as shown in Fig. 8, and each of the instantiated document 
prototypes may be linked to a card in the card database 106 (column 7, lines 1- 
15); Fig. 8; See 514 in Fig. 9; Fig. 13]. 
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8. Claims 23-32 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Shimizu etal. (US Patent 6,374,271 B1), in view of Newman etal. (US Patent 6,154, 
600), in further view of Rutledge (USPA Pub 2004/0054627 A1 ), and in further view of 
Efrat etal. (US 6,570,587 B1). 

As per claim 23 , Shimizu, Newman, and Rutledge disclose the claimed invention 
as detailed in claims 1 and 21 above. Furthermore, Newman discloses, "receiving user 
input to select a first property icon" as [See Graphics tab 492 in Fig. 12]. Furthermore, 
Newman discloses, "generating a property editor tool that corresponds to the property 
associated with the first property icon" as [Fig. 12]. Furthermore, Newman discloses, 
"the property editor tool is capable of configuring common program properties, media 
related properties, synchronization properties, annotation properties... narration 
properties and border properties" as [The present invention provides a complete, 
standalone, economical system that enables consumers to create, manipulate, 
edit, view and output hypermedia (column 17, lines 60-63); The term hypermedia 
refers to the integration of text, graphics, sound, video, and other data, or any 
combination into a primarily associative system for information presentation, 
storage and retrieval. For example, hypermedia includes motion pictures, music, 
animation and photographs (column 5, lines 47-50); Referring now to FIG. 8, a 
flowchart illustrates a method for manipulating hypermedia. At state 380, a 
consumer captures hypermedia to a storyboard. The storyboard often includes a 
plurality of captured hypermedia portions, or clips. At state 382, the consumer 
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manipulates the captured hypermedia on the story board... For example, 
consumers manipulate clips by enhancing them with graphics, text and audio 
annotations. Consumers may likewise enhance electronic mail (e-mail) by 
excerpting, editing and attaching the edited clips to their e-mail messages. 
Consumers also manipulate clips by compiling a sequence of clips and creating 
the transitions between each pair of clips. Additionally, consumers may 
manipulate clips by incorporating digitized photographs, synchronized music and 
other forms of digital hypermedia captured from the Internet via the Internet 
browser functionality incorporated into the non-linear editing system 100. For 
example, a consumer may manipulate a clip by excerpting a video still or a digital 
photograph from a clip for placement on a World Wide Web page or for printout 
as a photograph or postcard. At state 384, the consumer may modify the default 
transitions selected by the non-linear editing system 100. Moreover, at state 386, 
the system 100 enables consumers to add overlays, such as graphical and audio 
annotations of clips. Lastly, consumers may play back their story boards at state 
388 or copy their storyboards at state 390 (column 14, lines 10-37); Fig. 8]. Finally, 
Newman discloses, "editing at least one element of the selected property based on user 
input obtained through the property editor tool" as [FIG. 12 illustrates an embodiment 
of a graphics GUI 490. The graphics GUI 490 includes a graphics tab 492 having a 
scroll bar 494 and a plurality of icons 496 representing various graphics overlays, 
such as color, titles, and text on color. The graphics GUI 490 similarly includes a 
display window 408 to display an image for graphical editing. The graphics GUI 
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490 also includes an image edit window 498 having a plurality of image editing 
tool buttons 500, such as a line tool, a box tool, a text tool, cut, copy and paste, 
about the periphery of the image edit window 498... Moreover, the graphics GUI 
490 includes a features portion 502. The features portion 502 includes an name 
box 504, wherein the consumer may select a name to identify the edited graphic 
and a plurality of tabs 506, each tab having property selections for some of the 
image editing tool buttons 500. For example, a color tab 508 includes selection 
boxes 510 to select color features of lines, fills and shadows. Lastly, the features 
portion 502 includes a pair of slider bars 512, each having a slider 514, for the 
selection of color gradients. Operation of the graphics editor is similar to 
conventional graphics editors, such as MacPaint and Paintbrush (column 16, 
lines 21-44); Fig. 12]. 

Shimizu, Newman, and Rutledge all do not explicitly teach, "the property editor 
tool is capable of configuring... hotspot properties". 

However, Efrat discloses, "the property editor tool is capable of 
configuring. . . hotspot properties" as [The authoring tool 1001 may be used to define 
hotspots in media, such as video, and link 1010 the hotspots to targets (column 5, 
lines 2-3)]. 

Shimizu, Newman, Rutledge, and Efrat are analogous art because all three teach 
a method of configuring hypermedia. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to have combined the teachings of Efrat with the combined 
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teachings of Shimizu, Newman, and Rutledge because Efrat's teachings provide the 
combination of Shimizu's, Newman's, and Rutledge's method with the ability to create 
and display hyperlinks, or hotspots, in select regions of interest in frames of a video 
[column 2, lines 15-17]. 

As per claim 24 , Shimizu, Newman, and Rutledge disclose the claimed invention 
as detailed in claim 1 above. Furthermore, Newman discloses, "editing the program and 
property objects comprises: receiving user input to select a first program element within 
the program basket workspace" as [See "Intro Title" graphic selected in Graphics 
Tab //? Fig. 12; The graphics GUI 490... includes a display window 408 to display 
an image for graphical editing (column 16, lines 25-26); Fig. 12]. Furthermore, 
Newman discloses, "generating a property editor tool that corresponds to the program 
associated with the selected program element, wherein the property editor tool identifies 
the program properties referenced by the program associated with the selected program 
element" as [FIG. 12 illustrates an embodiment of a graphics GUI 490. The 
graphics GUI 490 includes a graphics tab 492 having a scroll bar 494 and a 
plurality of icons 496 representing various graphics overlays, such as color, 
titles, and text on color. The graphics GUI 490 similarly includes a display window 
408 to display an image for graphical editing. The graphics GUI 490 also includes 
an image edit window 498 having a plurality of image editing tool buttons 500, 
such as a line tool, a box tool, a text tool, cut, copy and paste, about the 
periphery of the image edit window 498... Moreover, the graphics GUI 490 
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includes a features portion 502. The features portion 502 includes an name box 
504, wherein the consumer may select a name to identify the edited graphic and a 
plurality of tabs 506, each tab having property selections for some of the image 
editing tool buttons 500. For example, a color tab 508 includes selection boxes 
510 to select color features of lines, fills and shadows. Lastly, the features portion 
502 includes a pair of slider bars 512, each having a slider 514, for the selection 
of color gradients. Operation of the graphics editor is similar to conventional 
graphics editors, such as MacPaint and Paintbrush (column 16, lines 21-44); Fig. 
12]. Furthermore, Newman discloses, "the property editor tool is capable of editing 
common program properties, media related properties, synchronization properties, 
annotation properties... narration properties and border properties" as [The present 
invention provides a complete, standalone, economical system that enables 
consumers to create, manipulate, edit, view and output hypermedia (column 17, 
lines 60-63); The term hypermedia refers to the integration of text, graphics, 
sound, video, and other data, or any combination into a primarily associative 
system for information presentation, storage and retrieval. For example, 
hypermedia includes motion pictures, music, animation and photographs 
(column 5, lines 47-50); Referring now to FIG. 8, a flowchart illustrates a method 
for manipulating hypermedia. At state 380, a consumer captures hypermedia to a 
storyboard. The storyboard often includes a plurality of captured hypermedia 
portions, or clips. At state 382, the consumer manipulates the captured 
hypermedia on the story board... For example, consumers manipulate clips by 



Application/Control Number: 1 0/671 ,966 Page 29 

Art Unit: 2164 

enhancing them with graphics, text and audio annotations. Consumers may 
likewise enhance electronic mail (e-mail) by excerpting, editing and attaching the 
edited clips to their e-mail messages. Consumers also manipulate clips by 
compiling a sequence of clips and creating the transitions between each pair of 
clips. Additionally, consumers may manipulate clips by incorporating digitized 
photographs, synchronized music and other forms of digital hypermedia 
captured from the Internet via the Internet browser functionality incorporated into 
the non-linear editing system 100. For example, a consumer may manipulate a 
clip by excerpting a video still or a digital photograph from a clip for placement 
on a World Wide Web page or for printout as a photograph or postcard. At state 
384, the consumer may modify the default transitions selected by the non-linear 
editing system 100. Moreover, at state 386, the system 100 enables consumers to 
add overlays, such as graphical and audio annotations of clips. Lastly, 
consumers may play back their storyboards at state 388 or copy their 
storyboards at state 390 (column 14, lines 10-37); Fig. 8]. Furthermore, Newman 
discloses, "receiving user input to select one of the program properties identified by the 
property editor tool to be edited" as [See Graphics tab 492 in Fig. 12]. Finally, 
Newman discloses, "editing the selected program property based on user input obtained 
through the property editor tool" as [FIG. 12 illustrates an embodiment of a graphics 
GUI 490. The graphics GUI 490 includes a graphics tab 492 having a scroll bar 494 
and a plurality of icons 496 representing various graphics overlays, such as 
color, titles, and text on color. The graphics GUI 490 similarly includes a display 
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window 408 to display an image for graphical editing. The graphics GUI 490 also 
includes an image edit window 498 having a plurality of image editing tool 
buttons 500, such as a line tool, a box tool, a text tool, cut, copy and paste, about 
the periphery of the image edit window 498... Moreover, the graphics GUI 490 
includes a features portion 502. The features portion 502 includes an name box 
504, wherein the consumer may select a name to identify the edited graphic and a 
plurality of tabs 506, each tab having property selections for some of the image 
editing tool buttons 500. For example, a color tab 508 includes selection boxes 
510 to select color features of lines, fills and shadows. Lastly, the features portion 
502 includes a pair of slider bars 512, each having a slider 514, for the selection 
of color gradients. Operation of the graphics editor is similar to conventional 
graphics editors, such as MacPaint and Paintbrush (column 16, lines 21-44); Fig. 
12]. 

Shimizu, Newman, and Rutledge all do not explicitly teach, "the property editor 
tool is capable of configuring... hotspot properties". 

However, Efrat discloses, "the property editor tool is capable of 
configuring... hotspot properties" as [The authoring tool 1001 maybe used to define 
hotspots in media, such as video, and link 1010 the hotspots to targets (column 5, 
lines 2-3)]. 

Shimizu, Newman, Rutledge, and Efrat are analogous art because all three teach 
a method of configuring hypermedia. 
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It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to have combined the teachings of Efrat with the combined 
teachings of Shimizu, Newman, and Rutledge because Efrat's teachings provide the 
combination of Shimizu's, Newman's, and Rutledge's method with the ability to create 
and display hyperlinks, or hotspots, in select regions of interest in frames of a video 
[column 2, lines 15-17]. 

As per claim 25 , Newman discloses, "implementing the property editor tool as a 
graphical user interface window which appears as a separate interface, wherein the 
property editor tool includes property tabs to identify the program properties referenced 
by the program associated with the selected program element" as [FIG. 12 illustrates 
an embodiment of a graphics GUI 490. The graphics GUI 490 includes a graphics 
tab 492 having a scroll bar 494 and a plurality of icons 496 representing various 
graphics overlays, such as color, titles, and text on color. The graphics GUI 490 
similarly includes a display window 408 to display an image for graphical editing. 
The graphics GUI 490 also includes an image edit window 498 having a plurality 
of image editing tool buttons 500, such as a line tool, a box tool, a text tool, cut, 
copy and paste, about the periphery of the image edit window 498... Moreover, the 
graphics GUI 490 includes a features portion 502. The features portion 502 
includes an name box 504, wherein the consumer may select a name to identify 
the edited graphic and a plurality of tabs 506, each tab having property selections 
for some of the image editing tool buttons 500. For example, a color tab 508 
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includes selection boxes 510 to select color features of lines, fills and shadows. 
Lastly, the features portion 502 includes a pair of slider bars 512, each having a 
slider 514, for the selection of color gradients. Operation of the graphics editor is 
similar to conventional graphics editors, such as MacPaint and Paintbrush 
(column 16, lines 21-44); Fig. 12]. 

As per claim 26 , Rutledge discloses, "the common program properties include a 
program name, a unique identifier, a user defined tag, a program description and 
references to other properties" as [The media ID software has a sophisticated 
graphical-user-interface (or GUI) that... provides functionality for the user to 
accept the default media ID organization structure or to configure a custom media 
ID organization structure... Each media ID has complete information about the 
media article such as publisher, date published, number of pages, media type, 
author, title, icon type, etc. (page 27, paragraph [0275], lines 1-13) Fig. 37]. 

As per claim 27 . Rutledge discloses, "the media related properties include 
attributes applicable to an individual media type, and other media related properties 
including author information, creation and modified dates, and media copyright 
information" as [Each media ID has complete information about the media article 
such as publisher, date published, number of pages, media type, author, title, 
icon type, etc. (page 27, paragraph [0275], lines 10-13); Fig. 37]. 
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As per claim 28 , Efrat discloses, "the hotspot properties include hotspot shape, 
size, location, action, text and highlighting" as [The authoring tool 1001 maybe used 
to define hotspots in media, such as video, and link 1010 the hotspots to targets 
(column 5, lines 2-3); The user can create a hypervideo that is nonlinear 1009 by 
linking 1010 a hotspot in a source media to one or more targets 7003. A target 
7003 may be a playing instance of a media element 1690 (column 18, lines 23-26); 
The Hotspot Properties... may include the hotspot name 7103, type of shape 7105 
defining the hotspot, media file name in which the hotspot is located 7107, the 
range of frames in a video media file in which the hotspot 8003 is located 7109, 
and cursor types. The cursor types include the cursor displayed when the pointer 
is over the hotspot 7111, and the cursor displayed when the mouse button is 
actuated when the pointer is over the hotspot 7113 (column 12, lines 55-64); size 
of the hotspot 8003 (column 17, line 12); hotspots in the form of an identifier (ID) 
(i.e. text) (column 6, lines 60-61); Fig. 7C]. 

As per claim 29 . Newman discloses, "the narration properties include font 
properties and text display related attributes" as [consumers manipulate clips by 
enhancing them with graphics, text, and audio annotations (column 14, lines 18- 
19); See Font Style in Fig. 12]. 
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As per claim 30 , Newman discloses, "the border properties include border text, 
size, colors and fonts" as [The graphics GUI 490. ..includes an image edit window 
498 having a plurality of image editing tool buttons 500, such as a line tool, a box 
tool, a text tool, cut, copy and paste, about the periphery of the image edit 
window 498. ..Moreover, the graphics GUI 490 includes a features portion 502. The 
features portion 502 includes... a plurality of tabs 506, each tab having property 
selections for some of the image editing tool buttons 500. For example, a color 
tab 508 includes selection boxes 510 to select color features of lines, fills and 
shadows. Lastly, the features portion 502 includes a pair of slider bars 512, each 
having a slider 514, for the selection of color gradients (column 16, lines 26-42); 
See Color tab 508 and Line and Font Style tabs 506 in Fig. 12]. 

As per claim 31 , Shimizu discloses, "providing a collection basket tool interface 
for configuring program properties, the collection basket tool interface comprising a 
program basket workspace" as [The hypermedia authoring system... provides a 
display for creating a presentation outline in the form of Bento-boxes. Each 
Bento-box includes a layout workspace in which spacer objects may be placed. 
Spatial and temporal parameters may also be specified corresponding to each 
spacer object. The spacer objects may be linked to cards in the card database 
and an indication of a link relationship with the goals outline is also provided 
(column 1, line 66 - column 2, line 6); Fig. 13]. Furthermore, Shimizu discloses, "an 
auxiliary workspace" as [Fig. 8]. Furthermore, Shimizu discloses, "the program basket 
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workspace comprises a plurality of program slots" as [The hypermedia authoring 
system... provides a display for creating a presentation outline in the form of 
Bento-boxes. Each Bento-box includes a layout workspace in which spacer 
objects may be placed. Spatial and temporal parameters may also be specified 
corresponding to each spacer object. The spacer objects may be linked to cards 
in the card database and an indication of a link relationship with the goals outline 
is also provided (column 1, line 66 - column 2, line 6); Fig. 13]. Furthermore, 
Shimizu discloses, "implementing the collection basket tool interface as a graphic user 
interface, wherein the program basket workspace is implemented as a first graphical 
user interface window" as [The hypermedia authoring system... provides a display 
for creating a presentation outline in the form of Bento-boxes. Each Bento-box 
includes a layout workspace in which spacer objects may be placed. Spatial and 
temporal parameters may also be specified corresponding to each spacer object. 
The spacer objects may be linked to cards in the card database and an indication 
of a link relationship with the goals outline is also provided (column 1, line 66 - 
column 2, line 6); Fig. 13]. Furthermore, Shimizu discloses, "the auxiliary workspace is 
implemented as a second graphical user interface window" as [The goals outline 
processor 608 processes the goals outline by displaying a goals outline display 
400 on the display device 605 and generates the goals outline 102 based on user 
inputs received through the keyboard/mouse 609... Fig. 8 shows the goals outline 
display 400 that includes a tree view area 402, a card link area 404, and a 
document prototype legend area 406. The tree view 402 displays the tree view 408 
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of the goals outline 202. Each of the nodes 206-214 are represented by square 
boxes that are connected to a respective icon such as icon 432 corresponding to 
node 206. Each of the icons 432, 436, 438, 440, and 460 are coded, by color for 
example, based on the document prototype that is instantiated to correspond to 
the respective nodes 206-214. For example, the icon 432 is colored blue as 
represented by the horizontal parallel lines; icon 438 is colored red as 
represented by the parallel vertical lines; and icon 440 is colored green as 
represented by the parallel slanted lines. As shown in the legend area 406, the 
blue color indicated in area 424 corresponds to a description document 
prototype; the green color indicated in area 426 corresponds to an argument 
prototype; and the red color indicated in area 428 corresponds to a narrative 
prototype (column 5, lines 44-65); Fig. 8]. Furthermore, Shimizu discloses, 
"generating at least one program and one or more program properties associated with 
the imported media" as [the hypermedia authoring system provides a display that 
permits the author to link each of the slot types of an instantiated document 
prototype with cards in a card database. Cards may... be created from scratch by 
the author or imported from external sources and linked with the instantiated 
document prototype (column 1, lines 60-65); The related goals outline nodes are 
goals outline nodes that are linked to cards which are also linked to spacer 
objects in the Bento-box 800 (column 7, lines 48-50); The cards in the card 
database 106 are information elements (called points) on which the document 
being authored is based... the cards contain the actual hypermedia information 
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such as video, sound or text that make up the document. The contents of the 
points may be appropriated from either external sources or created from scratch 
by the author (column 3, lines 38-44); Fig. 8 and Fig. 13]. Furthermore, Shimizu 
discloses, "each program is a program object" as [The cards in the card database 106 
are information elements (called points) on which the document being authored 
is based... the cards contain the actual hypermedia information such as video, 
sound or text that make up the document. The contents of the points may be 
appropriated from either external sources or created from scratch by the author 
(column 3, lines 38-44); Bento-box (column 7, line 36); The Bento-boxes may be 
linked to each other in a stack for a sequential slide presentation (column 2, lines 
12-13)]. Furthermore, Shimizu discloses, "each program property is an object" as [The 
spacer objects 706-718 (column 7, line 35); related goals outline nodes (column 7, 
lines 46-48); Fig. 13]. Furthermore, Shimizu discloses, "each program object 
references at least one program property object" as [The related goals outline nodes 
are goals outline nodes that are linked to cards which are also linked to spacer 
objects in the Bento-box 800 (column 7, lines 48-50); The cards in the card 
database 106 are information elements (called points) on which the document 
being authored is based... the cards contain the actual hypermedia information 
such as video, sound or text that make up the document. The contents of the 
points may be appropriated from either external sources or created from scratch 
by the author (column 3, lines 38-44); Fig. 8 and Fig. 13]. Furthermore, Shimizu 
discloses, "creating a program element to represent each generated program, wherein 
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each program element is displayed within separate program slots of the program basket 
workspace" as [The hypermedia authoring system... provides a display for creating 
a presentation outline in the form of Bento-boxes. Each Bento-box includes a 
layout workspace in which spacer objects may be placed. Spatial and temporal 
parameters may also be specified corresponding to each spacer object. The 
spacer objects may be linked to cards in the card database and an indication of a 
link relationship with the goals outline is also provided (column 1, line 66 - 
column 2, line 6); The cards in the card database 106 are information elements 
(called points) on which the document being authored is based... the cards 
contain the actual hypermedia information such as video, sound or text that make 
up the document. The contents of the points may be appropriated from either 
external sources or created from scratch by the author (column 3, lines 38-44); 
Bento-box 800 (which may be a card) (column 7, lines 36-37); The Bento-boxes 
may be linked to each other in a stack for a sequential slide presentation (column 
2, lines 12-13); The cutting board 1508 displays the presentation outline. The 
Bento-boxes 1510 and 1512 are shown on the cutting board 1508 (column 9, lines 
39-42); Fig. 13 and Fig. 21]. Furthermore, Shimizu discloses, "creating one or more 
property icons within each program slot displaying the program elements, wherein the 
property icons represent the program properties referenced by the program associated 
with the displayed program element [The hypermedia authoring system... provides a 
display for creating a presentation outline in the form of Bento-boxes. Each 
Bento-box includes a layout workspace in which spacer objects may be placed. 
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Spatial and temporal parameters may also be specified corresponding to each 
spacer object. The spacer objects may be linked to cards in the card database 
and an indication of a link relationship with the goals outline is also provided 
(column 1, line 66 - column 2, line 6); Fig. 13]. Finally, Shimizu discloses, 
"configuring the programs by manipulating the program properties through actions 
performed on their associated property icons within the program basket workspace, 
wherein the actions are performed based on user input" as [The goals outline 
processor 608 processes the goals outline by displaying a goals outline display 
400 on the display device 605 and generates the goals outline 102 based on user 
inputs received through the keyboard/mouse 609... Fig. 8 shows the goals outline 
display 400 that includes a tree view area 402, a card link area 404, and a 
document prototype legend area 406. The tree view 402 displays the tree view 408 
of the goals outline 202. Each of the nodes 206-214 are represented by square 
boxes that are connected to a respective icon such as icon 432 corresponding to 
node 206. Each of the icons 432, 436, 438, 440, and 460 are coded, by color for 
example, based on the document prototype that is instantiated to correspond to 
the respective nodes 206-214. For example, the icon 432 is colored blue as 
represented by the horizontal parallel lines; icon 438 is colored red as 
represented by the parallel vertical lines; and icon 440 is colored green as 
represented by the parallel slanted lines. As shown in the legend area 406, the 
blue color indicated in area 424 corresponds to a description document 
prototype; the green color indicated in area 426 corresponds to an argument 
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prototype; and the red color indicated in area 428 corresponds to a narrative 
prototype (column 5, lines 44-65); Fig. 8]. 

Shimizu does not explicitly teach, "a computer-implemented method for 
processing media and configuring program properties associated with the media for a 
digital document", "a property editor tool", "the auxiliary workspace comprises at least 
one media configuration tool", "the property editor tool is capable of editing common 
program properties, media related properties, synchronization properties, annotation 
properties... narration properties and border properties", "the property editor tool is 
implemented as a third graphical user interface window", "configuring the program 
properties, further comprising the steps of: receiving user input to select a first property 
icon", "generating the property editor tool that corresponds to the property associated 
with the first property icon", and "editing at least one element of the selected property 
based on user input obtained through the property editor tool". 

However, Newman discloses, "a computer-implemented method for processing 
media and configuring program properties associated with the media for a digital 
document" as [The present invention provides a complete, standalone, economical 
system that enables consumers to create, manipulate, edit, view and output 
hypermedia (column 17, lines 60-63); The term hypermedia refers to the 
integration of text, graphics, sound, video, and other data, or any combination 
into a primarily associative system for information presentation, storage and 
retrieval. For example, hypermedia includes motion pictures, music, animation 
and photographs (column 5, lines 47-50); FIG. 12 illustrates an embodiment of a 
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graphics GUI 490. The graphics GUI 490 includes a graphics tab 492 having a 
scroll bar 494 and a plurality of icons 496 representing various graphics overlays, 
such as color, titles, and text on color. The graphics GUI 490 similarly includes a 
display window 408 to display an image for graphical editing. The graphics GUI 
490 also includes an image edit window 498 having a plurality of image editing 
tool buttons 500, such as a line tool, a box tool, a text tool, cut, copy and paste, 
about the periphery of the image edit window 498... Moreover, the graphics GUI 
490 includes a features portion 502. The features portion 502 includes a name box 
504, wherein the consumer may select a name to identify the edited graphic and a 
plurality of tabs 506, each tab having property selections for some of the image 
editing tool buttons 500. For example, a color tab 508 includes selection boxes 
510 to select color features of lines, fills and shadows. Lastly, the features portion 
502 includes a pair of slider bars 512, each having a slider 514, for the selection 
of color gradients. Operation of the graphics editor is similar to conventional 
graphics editors, such as MacPaint and Paintbrush (column 16, lines 21-44); Fig. 
12]. Furthermore, Newman discloses, "a property editor tool" as [Fig. 12]. Furthermore, 
Newman discloses, "the auxiliary workspace comprises at least one media configuration 
tool" as [The present invention provides a complete, standalone, economical 
system that enables consumers to create, manipulate, edit, view and output 
hypermedia (column 17, lines 60-63); The term hypermedia refers to the 
integration of text, graphics, sound, video, and other data, or any combination 
into a primarily associative system for information presentation, storage and 
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retrieval. For example, hypermedia includes motion pictures, music, animation 
and photographs (column 5, lines 47-50); FIG. 12 illustrates an embodiment of a 
graphics GUI 490. The graphics GUI 490 includes a graphics tab 492 having a 
scroll bar 494 and a plurality of icons 496 representing various graphics overlays, 
such as color, titles, and text on color. The graphics GUI 490 similarly includes a 
display window 408 to display an image for graphical editing. The graphics GUI 
490 also includes an image edit window 498 having a plurality of image editing 
tool buttons 500, such as a line tool, a box tool, a text tool, cut, copy and paste, 
about the periphery of the image edit window 498... Moreover, the graphics GUI 
490 includes a features portion 502. The features portion 502 includes a name box 
504, wherein the consumer may select a name to identify the edited graphic and a 
plurality of tabs 506, each tab having property selections for some of the image 
editing tool buttons 500. For example, a color tab 508 includes selection boxes 
510 to select color features of lines, fills and shadows. Lastly, the features portion 
502 includes a pair of slider bars 512, each having a slider 514, for the selection 
of color gradients. Operation of the graphics editor is similar to conventional 
graphics editors, such as MacPaint and Paintbrush (column 16, lines 21-44); Fig. 
12]. Furthermore, Newman discloses, "the property editor tool is capable of editing 
common program properties, media related properties, synchronization properties, 
annotation properties... narration properties and border properties" as [The present 
invention provides a complete, standalone, economical system that enables 
consumers to create, manipulate, edit, view and output hypermedia (column 17, 
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lines 60-63); The term hypermedia refers to the integration of text, graphics, 
sound, video, and other data, or any combination into a primarily associative 
system for information presentation, storage and retrieval. For example, 
hypermedia includes motion pictures, music, animation and photographs 
(column 5, lines 47-50); Referring now to FIG. 8, a flowchart illustrates a method 
for manipulating hypermedia. At state 380, a consumer captures hypermedia to a 
storyboard. The storyboard often includes a plurality of captured hypermedia 
portions, or clips. At state 382, the consumer manipulates the captured 
hypermedia on the storyboard... For example, consumers manipulate clips by 
enhancing them with graphics, text and audio annotations. Consumers may 
likewise enhance electronic mail (e-mail) by excerpting, editing and attaching the 
edited clips to their e-mail messages. Consumers also manipulate clips by 
compiling a sequence of clips and creating the transitions between each pair of 
clips. Additionally, consumers may manipulate clips by incorporating digitized 
photographs, synchronized music and other forms of digital hypermedia 
captured from the Internet via the Internet browser functionality incorporated into 
the non-linear editing system 100. For example, a consumer may manipulate a 
clip by excerpting a video still or a digital photograph from a clip for placement 
on a World Wide Web page or for printout as a photograph or postcard. At state 
384, the consumer may modify the default transitions selected by the non-linear 
editing system 100. Moreover, at state 386, the system 100 enables consumers to 
add overlays, such as graphical and audio annotations of clips. Lastly, 
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consumers may play back their storyboards at state 388 or copy their 
storyboards at state 390 (column 14, lines 10-37); Fig. 8]. Furthermore, Newman 
discloses, "the property editor tool is implemented as a third graphical user interface 
window" as [See Fig. 12]. Furthermore, Newman discloses, "configuring the program 
properties, further comprising the steps of: receiving user input to select a first property 
icon" as [See Graphics tab 492 in Fig. 12]. Furthermore, Newman discloses, 
"generating the property editor tool that corresponds to the property associated with the 
first property icon" as [Fig. 12]. Finally, Newman discloses, "editing at least one element 
of the selected property based on user input obtained through the property editor tool" 
as [FIG. 12 illustrates an embodiment of a graphics GUI 490. The graphics GUI 490 
includes a graphics tab 492 having a scroll bar 494 and a plurality of icons 496 
representing various graphics overlays, such as color, titles, and text on color. 
The graphics GUI 490 similarly includes a display window 408 to display an image 
for graphical editing. The graphics GUI 490 also includes an image edit window 
498 having a plurality of image editing tool buttons 500, such as a line tool, a box 
tool, a text tool, cut, copy and paste, about the periphery of the image edit 
window 498. ..Moreover, the graphics GUI 490 includes a features portion 502. The 
features portion 502 includes an name box 504, wherein the consumer may select 
a name to identify the edited graphic and a plurality of tabs 506, each tab having 
property selections for some of the image editing tool buttons 500. For example, 
a color tab 508 includes selection boxes 510 to select color features of lines, fills 
and shadows. Lastly, the features portion 502 includes a pair of slider bars 512, 
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each having a slider 514, for the selection of color gradients. Operation of the 
graphics editor is similar to conventional graphics editors, such as MacPaint and 
Paintbrush (column 16, lines 21-44); Fig. 12]. 

Shimizu and Newman are analogous art because they both teach a method for 
configuring properties for a digital document. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to have combined the teachings of Newman with the teachings of 
Shimizu because Newman's teachings provide Shimizu's method with a complete, 
standalone, economical system that enables consumers to create, manipulate, edit, 
view and output hypermedia [column 17, lines 60-63]. For example, the graphics GUI 
allows a user to edit graphics included in a hypermedia [column 16, lines 21-44]. 

Furthermore, Shimizu and Newman both do not explicitly teach, "receiving user 
input to select the media to import using the media configuration tool" and "importing the 
media selected by the user". 

However, Rutledge discloses, "receiving user input to select the media to import 
using the media configuration tool" as [The media ID software has a sophisticated 
graphical-user-interface (or GUI) that allows the user to navigate through the 
locally stored media IDs, initiate complicated search queries for local and remote 
media and media IDs, and retrieve articles of media and media IDs... the media ID 
and the media ID software contain the necessary information required to transfer 
the entire text and graphics of the original article of media between the web 
server and the media ID software 1080... when the user clicks on a media ID such 
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as the one located at 1070 in FIG. 22, the entire text and graphics of the media 
article 1068 will be transferred along with the media ID 1070 to the media ID 
software 1080 (page 27, paragraph [0275], lines 1-24); The media ID software 
program manages media IDs and their content, provides advanced query tools for 
searching and sorting of media ID content, manages the download and transfer of 
media IDs and associated electronic documents, and includes screens, windows 
or other facilities for quick and easy previewing of electronic documents (page 
31, paragraph [0319], lines 1-7); Fig. 33, Fig. 37 and Fig. 39-41]. Finally, Rutledge 
discloses, "importing the media selected by the user" as [The media ID software has a 
sophisticated graphical-user-interface (or GUI) that allows the user to navigate 
through the locally stored media IDs, initiate complicated search queries for local 
and remote media and media IDs, and retrieve articles of media and media IDs... 
the media ID and the media ID software contain the necessary information 
required to transfer the entire text and graphics of the original article of media 
between the web server and the media ID software 1080. ..when the user clicks on 
a media ID such as the one located at 1070 in FIG. 22, the entire text and graphics 
of the media article 1068 will be transferred along with the media ID 1070 to the 
media ID software 1080 (page 27, paragraph [0275], lines 1-24); The media ID 
software program manages media IDs and their content, provides advanced 
query tools for searching and sorting of media ID content, manages the download 
and transfer of media IDs and associated electronic documents, and includes 
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screens, windows or other facilities for quick and easy previewing of electronic 
documents (page 31, paragraph [0319], lines 1-7); Fig. 33, Fig. 37 and Fig. 39-41]. 

Shimizu, Newman, and Rutledge are analogous art because all three teach a 
method of configuring hypermedia. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to have combined the teachings of Rutledge with the combined 
teachings of Shimizu and Newman because Rutledge's teachings provide the 
combination of Shimizu's and Newman's method with sophisticated media search tools 
to facilitate the media search process [(page 36, paragraph [0369], lines 1-2); Fig. 39 
-Fig. 41]. 

Furthermore, Shimizu, Newman, and Rutledge all do not explicitly teach, "the 
property editor tool is capable of configuring... hotspot properties". 

However, Efrat discloses, "the property editor tool is capable of 
configuring. . . hotspot properties" as [The authoring tool 1001 may be used to define 
hotspots in media, such as video, and link 1010 the hotspots to targets (column 5, 
lines 2-3)]. 

Shimizu, Newman, Rutledge, and Efrat are analogous art because all three teach 
a method of configuring hypermedia. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to have combined the teachings of Efrat with the combined 
teachings of Shimizu, Newman, and Rutledge because Efrat's teachings provide the 
combination of Shimizu's, Newman's, and Rutledge's method with the ability to create 
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and display hyperlinks, or hotspots, in select regions of interest in frames of a video 
[column 2, lines 15-17]. 

As per claim 32 , Shimizu discloses, "providing a collection basket tool interface 
for configuring program properties, the collection basket tool interface comprising a 
program basket workspace" as [The hypermedia authoring system... provides a 
display for creating a presentation outline in the form of Bento-boxes. Each 
Bento-box includes a layout workspace in which spacer objects may be placed. 
Spatial and temporal parameters may also be specified corresponding to each 
spacer object. The spacer objects may be linked to cards in the card database 
and an indication of a link relationship with the goals outline is also provided 
(column 1, line 66 - column 2, line 6); Fig. 13]. Furthermore, Shimizu discloses, "an 
auxiliary workspace" as [Fig. 8]. Furthermore, Shimizu discloses, "the program basket 
workspace comprises a plurality of program slots" as [The hypermedia authoring 
system... provides a display for creating a presentation outline in the form of 
Bento-boxes. Each Bento-box includes a layout workspace in which spacer 
objects may be placed. Spatial and temporal parameters may also be specified 
corresponding to each spacer object. The spacer objects may be linked to cards 
in the card database and an indication of a link relationship with the goals outline 
is also provided (column 1, line 66 - column 2, line 6); Fig. 13]. Furthermore, 
Shimizu discloses, "implementing the collection basket tool interface as a graphic user 
interface, wherein the program basket workspace is implemented as a first graphical 
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user interface window" as [The hypermedia authoring system... provides a display 
for creating a presentation outline in the form of Bento-boxes. Each Bento-box 
includes a layout workspace in which spacer objects may be placed. Spatial and 
temporal parameters may also be specified corresponding to each spacer object. 
The spacer objects may be linked to cards in the card database and an indication 
of a link relationship with the goals outline is also provided (column 1, line 66 - 
column 2, line 6); Fig. 13]. Furthermore, Shimizu discloses, "the auxiliary workspace is 
implemented as a second graphical user interface window" as [The goals outline 
processor 608 processes the goals outline by displaying a goals outline display 
400 on the display device 605 and generates the goals outline 102 based on user 
inputs received through the keyboard/mouse 609. ..Fig. 8 shows the goals outline 
display 400 that includes a tree view area 402, a card link area 404, and a 
document prototype legend area 406. The tree view 402 displays the tree view 408 
of the goals outline 202. Each of the nodes 206-214 are represented by square 
boxes that are connected to a respective icon such as icon 432 corresponding to 
node 206. Each of the icons 432, 436, 438, 440, and 460 are coded, by color for 
example, based on the document prototype that is instantiated to correspond to 
the respective nodes 206-214. For example, the icon 432 is colored blue as 
represented by the horizontal parallel lines; icon 438 is colored red as 
represented by the parallel vertical lines; and icon 440 is colored green as 
represented by the parallel slanted lines. As shown in the legend area 406, the 
blue color indicated in area 424 corresponds to a description document 
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prototype; the green color indicated in area 426 corresponds to an argument 
prototype; and the red color indicated in area 428 corresponds to a narrative 
prototype (column 5, lines 44-65); Fig. 8]. Furthermore, Shimizu discloses, 
"generating at least one program and one or more program properties associated with 
the imported media" as [the hypermedia authoring system provides a display that 
permits the author to link each of the slot types of an instantiated document 
prototype with cards in a card database. Cards may... be created from scratch by 
the author or imported from external sources and linked with the instantiated 
document prototype (column 1, lines 60-65); The related goals outline nodes are 
goals outline nodes that are linked to cards which are also linked to spacer 
objects in the Bento-box 800 (column 7, lines 48-50); The cards in the card 
database 106 are information elements (called points) on which the document 
being authored is based... the cards contain the actual hypermedia information 
such as video, sound or text that make up the document. The contents of the 
points may be appropriated from either external sources or created from scratch 
by the author (column 3, lines 38-44); Fig. 8 and Fig. 13]. Furthermore, Shimizu 
discloses, "each program is a program object" as [The cards in the card database 106 
are information elements (called points) on which the document being authored 
is based... the cards contain the actual hypermedia information such as video, 
sound or text that make up the document. The contents of the points may be 
appropriated from either external sources or created from scratch by the author 
(column 3, lines 38-44); Bento-box (column 7, line 36); The Bento-boxes maybe 
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linked to each other in a stack for a sequential slide presentation (column 2, lines 
12-13)]. Furthermore, Shimizu discloses, "each program property is an object" as [The 
spacer objects 706-718 (column 7, line 35); related goals outline nodes (column 7, 
lines 46-48); Fig. 13]. Furthermore, Shimizu discloses, "each program object 
references at least one program property object" as [The related goals outline nodes 
are goals outline nodes that are linked to cards which are also linked to spacer 
objects in the Bento-box 800 (column 7, lines 48-50); The cards in the card 
database 106 are information elements (called points) on which the document 
being authored is based... the cards contain the actual hypermedia information 
such as video, sound or text that make up the document. The contents of the 
points may be appropriated from either external sources or created from scratch 
by the author (column 3, lines 38-44); Fig. 8 and Fig. 13]. Finally, Shimizu discloses, 
"creating a program element to represent each generated program, wherein each 
program element is displayed within separate program slots of the program basket 
workspace" as [The hypermedia authoring system... provides a display for creating 
a presentation outline in the form of Bento-boxes. Each Bento-box includes a 
layout workspace in which spacer objects may be placed. Spatial and temporal 
parameters may also be specified corresponding to each spacer object. The 
spacer objects may be linked to cards in the card database and an indication of a 
link relationship with the goals outline is also provided (column 1, line 66 - 
column 2, line 6); The cards in the card database 106 are information elements 
(called points) on which the document being authored is based... the cards 
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contain the actual hypermedia information such as video, sound or text that make 
up the document. The contents of the points may be appropriated from either 
external sources or created from scratch by the author (column 3, lines 38-44); 
Bento-box 800 (which may be a card) (column 7, lines 36-37); The Bento-boxes 
may be linked to each other in a stack for a sequential slide presentation (column 
2, lines 12-13); The cutting board 1508 displays the presentation outline. The 
Bento-boxes 1510 and 1512 are shown on the cutting board 1508 (column 9, lines 
39-42); Fig. 13 and Fig. 21]. 

Shimizu does not explicitly teach, "a computer-implemented method for 
processing media and configuring program properties associated with the media for a 
digital document", "a property editor tool", "the auxiliary workspace comprises at least 
one media configuration tool", "the property editor tool is capable of editing common 
program properties, media related properties, synchronization properties, annotation 
properties... narration properties and border properties", "receiving user input to select a 
first program element within the program basket workspace", "generating a property 
editor tool that corresponds to the program associated with the first program element", 
"the property editor tool is implemented as a graphical user interface window which 
appears as a separate interface, wherein the property editor tool includes property tabs 
to identify the program properties referenced by the program associated with the 
selected program element", "receiving user input to select one of the property tabs 
associated with the program property to be edited", "bringing to the foreground a page 
within the property editor tool for configuring the respective program property", and 
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"editing the respective program property based on user input obtained within the page 
of the property editor tool" 

However, Newman discloses, "a computer-implemented method for processing 
media and configuring program properties associated with the media for a digital 
document" as [The present invention provides a complete, standalone, economical 
system that enables consumers to create, manipulate, edit, view and output 
hypermedia (column 17, lines 60-63); The term hypermedia refers to the 
integration of text, graphics, sound, video, and other data, or any combination 
into a primarily associative system for information presentation, storage and 
retrieval. For example, hypermedia includes motion pictures, music, animation 
and photographs (column 5, lines 47-50); FIG. 12 illustrates an embodiment of a 
graphics GUI 490. The graphics GUI 490 includes a graphics tab 492 having a 
scroll bar 494 and a plurality of icons 496 representing various graphics overlays, 
such as color, titles, and text on color. The graphics GUI 490 similarly includes a 
display window 408 to display an image for graphical editing. The graphics GUI 
490 also includes an image edit window 498 having a plurality of image editing 
tool buttons 500, such as a line tool, a box tool, a text tool, cut, copy and paste, 
about the periphery of the image edit window 498... Moreover, the graphics GUI 
490 includes a features portion 502. The features portion 502 includes a name box 
504, wherein the consumer may select a name to identify the edited graphic and a 
plurality of tabs 506, each tab having property selections for some of the image 
editing tool buttons 500. For example, a color tab 508 includes selection boxes 
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510 to select color features of lines, fills and shadows. Lastly, the features portion 
502 includes a pair of slider bars 512, each having a slider 514, for the selection 
of color gradients. Operation of the graphics editor is similar to conventional 
graphics editors, such as MacPaint and Paintbrush (column 16, lines 21-44); Fig. 
12]. Furthermore, Newman discloses, "a property editor tool" as [Fig. 12]. Furthermore, 
Newman discloses, "the auxiliary workspace comprises at least one media configuration 
tool" as [The present invention provides a complete, standalone, economical 
system that enables consumers to create, manipulate, edit, view and output 
hypermedia (column 17, lines 60-63); The term hypermedia refers to the 
integration of text, graphics, sound, video, and other data, or any combination 
into a primarily associative system for information presentation, storage and 
retrieval. For example, hypermedia includes motion pictures, music, animation 
and photographs (column 5, lines 47-50); FIG. 12 illustrates an embodiment of a 
graphics GUI 490. The graphics GUI 490 includes a graphics tab 492 having a 
scroll bar 494 and a plurality of icons 496 representing various graphics overlays, 
such as color, titles, and text on color. The graphics GUI 490 similarly includes a 
display window 408 to display an image for graphical editing. The graphics GUI 
490 also includes an image edit window 498 having a plurality of image editing 
tool buttons 500, such as a line tool, a box tool, a text tool, cut, copy and paste, 
about the periphery of the image edit window 498... Moreover, the graphics GUI 
490 includes a features portion 502. The features portion 502 includes a name box 
504, wherein the consumer may select a name to identify the edited graphic and a 
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plurality of tabs 506, each tab having property selections for some of the image 
editing tool buttons 500. For example, a color tab 508 includes selection boxes 
510 to select color features of lines, fills and shadows. Lastly, the features portion 
502 includes a pair of slider bars 512, each having a slider 514, for the selection 
of color gradients. Operation of the graphics editor is similar to conventional 
graphics editors, such as MacPaint and Paintbrush (column 16, lines 21-44); Fig. 
12]. Furthermore, Newman discloses, "the property editor tool is capable of editing 
common program properties, media related properties, synchronization properties, 
annotation properties... narration properties and border properties" as [The present 
invention provides a complete, standalone, economical system that enables 
consumers to create, manipulate, edit, view and output hypermedia (column 17, 
lines 60-63); The term hypermedia refers to the integration of text, graphics, 
sound, video, and other data, or any combination into a primarily associative 
system for information presentation, storage and retrieval. For example, 
hypermedia includes motion pictures, music, animation and photographs 
(column 5, lines 47-50); Referring now to FIG. 8, a flowchart illustrates a method 
for manipulating hypermedia. At state 380, a consumer captures hypermedia to a 
storyboard. The storyboard often includes a plurality of captured hypermedia 
portions, or clips. At state 382, the consumer manipulates the captured 
hypermedia on the story board... For example, consumers manipulate clips by 
enhancing them with graphics, text and audio annotations. Consumers may 
likewise enhance electronic mail (e-mail) by excerpting, editing and attaching the 
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edited clips to their e-mail messages. Consumers also manipulate clips by 
compiling a sequence of clips and creating the transitions between each pair of 
clips. Additionally, consumers may manipulate clips by incorporating digitized 
photographs, synchronized music and other forms of digital hypermedia 
captured from the Internet via the Internet browser functionality incorporated into 
the non-linear editing system 100. For example, a consumer may manipulate a 
clip by excerpting a video still or a digital photograph from a clip for placement 
on a World Wide Web page or for printout as a photograph or postcard. At state 
384, the consumer may modify the default transitions selected by the non-linear 
editing system 100. Moreover, at state 386, the system 100 enables consumers to 
add overlays, such as graphical and audio annotations of clips. Lastly, 
consumers may play back their storyboards at state 388 or copy their 
storyboards at state 390 (column 14, lines 10-37); Fig. 8]. Furthermore, Newman 
discloses, "receiving user input to select a first program element within the program 
basket workspace" as [See "Intro Title" graphic selected in Graphics Tab in Fig. 12; 
The graphics GUI 490... includes a display window 408 to display an image for 
graphical editing (column 16, lines 25-26); Fig. 12]. Furthermore, Newman discloses, 
"generating a property editor tool that corresponds to the program associated with the 
first program element" as [Fig. 12]. Furthermore, Newman discloses, "the property 
editor tool is implemented as a graphical user interface window which appears as a 
separate interface, wherein the property editor tool includes property tabs to identify the 
program properties referenced by the program associated with the selected program 
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element" as [FIG. 12 illustrates an embodiment of a graphics GUI 490. The 
graphics GUI 490 includes a graphics tab 492 having a scroll bar 494 and a 
plurality of icons 496 representing various graphics overlays, such as color, 
titles, and text on color. The graphics GUI 490 similarly includes a display window 
408 to display an image for graphical editing. The graphics GUI 490 also includes 
an image edit window 498 having a plurality of image editing tool buttons 500, 
such as a line tool, a box tool, a text tool, cut, copy and paste, about the 
periphery of the image edit window 498... Moreover, the graphics GUI 490 
includes a features portion 502. The features portion 502 includes an name box 
504, wherein the consumer may select a name to identify the edited graphic and a 
plurality of tabs 506, each tab having property selections for some of the image 
editing tool buttons 500. For example, a color tab 508 includes selection boxes 
510 to select color features of lines, fills and shadows. Lastly, the features portion 
502 includes a pair of slider bars 512, each having a slider 514, for the selection 
of color gradients. Operation of the graphics editor is similar to conventional 
graphics editors, such as MacPaint and Paintbrush (column 16, lines 21-44); Fig. 
12]. Furthermore, Newman discloses, "receiving user input to select one of the property 
tabs associated with the program property to be edited" as [See Graphics tab 492 in 
Fig. 12]. Furthermore, Newman discloses, "bringing to the foreground a page within the 
property editor tool for configuring the respective program property" as [See Graphics 
tab 492 in Fig. 12]. Finally, Newman discloses, "editing the respective program 
property based on user input obtained within the page of the property editor tool" as 
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[FIG. 12 illustrates an embodiment of a graphics GUI 490. The graphics GUI 490 
includes a graphics tab 492 having a scroll bar 494 and a plurality of icons 496 
representing various graphics overlays, such as color, titles, and text on color. 
The graphics GUI 490 similarly includes a display window 408 to display an image 
for graphical editing. The graphics GUI 490 also includes an image edit window 
498 having a plurality of image editing tool buttons 500, such as a line tool, a box 
tool, a text tool, cut, copy and paste, about the periphery of the image edit 
window 498... Moreover, the graphics GUI 490 includes a features portion 502. The 
features portion 502 includes an name box 504, wherein the consumer may select 
a name to identify the edited graphic and a plurality of tabs 506, each tab having 
property selections for some of the image editing tool buttons 500. For example, 
a color tab 508 includes selection boxes 510 to select color features of lines, fills 
and shadows. Lastly, the features portion 502 includes a pair of slider bars 512, 
each having a slider 514, for the selection of color gradients. Operation of the 
graphics editor is similar to conventional graphics editors, such as MacPaint and 
Paintbrush (column 16, lines 21-44); Fig. 12]. 

Shimizu and Newman are analogous art because they both teach a method for 
configuring properties for a digital document. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to have combined the teachings of Newman with the teachings of 
Shimizu because Newman's teachings provide Shimizu's method with a complete, 
standalone, economical system that enables consumers to create, manipulate, edit, 
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view and output hypermedia [column 17, lines 60-63]. For example, the graphics GUI 
allows a user to edit graphics included in a hypermedia [column 16, lines 21-44]. 

Furthermore, Shimizu and Newman both do not explicitly teach, "receiving user 
input to select the media to import using the media configuration tool" and "importing the 
media selected by the user". 

However, Rutledge discloses, "receiving user input to select the media to import 
using the media configuration tool" as [The media ID software has a sophisticated 
graphical-user-interface (or GUI) that allows the user to navigate through the 
locally stored media IDs, initiate complicated search queries for local and remote 
media and media IDs, and retrieve articles of media and media IDs... the media ID 
and the media ID software contain the necessary information required to transfer 
the entire text and graphics of the original article of media between the web 
server and the media ID software 1080... when the user clicks on a media ID such 
as the one located at 1070 in FIG. 22, the entire text and graphics of the media 
article 1068 will be transferred along with the media ID 1070 to the media ID 
software 1080 (page 27, paragraph [0275], lines 1-24); The media ID software 
program manages media IDs and their content, provides advanced query tools for 
searching and sorting of media ID content, manages the download and transfer of 
media IDs and associated electronic documents, and includes screens, windows 
or other facilities for quick and easy previewing of electronic documents (page 
31, paragraph [0319], lines 1-7); Fig. 33, Fig. 37 and Fig. 39-41]. Finally, Rutledge 
discloses, "importing the media selected by the user" as [The media ID software has a 
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sophisticated graphical-user-interface (or GUI) that allows the user to navigate 
through the locally stored media IDs, initiate complicated search queries for local 
and remote media and media IDs, and retrieve articles of media and media IDs... 
the media ID and the media ID software contain the necessary information 
required to transfer the entire text and graphics of the original article of media 
between the web server and the media ID software 1080... when the user clicks on 
a media ID such as the one located at 1070 in FIG. 22, the entire text and graphics 
of the media article 1068 will be transferred along with the media ID 1070 to the 
media ID software 1080 (page 27, paragraph [0275], lines 1-24); The media ID 
software program manages media IDs and their content, provides advanced 
query tools for searching and sorting of media ID content, manages the download 
and transfer of media IDs and associated electronic documents, and includes 
screens, windows or other facilities for quick and easy previewing of electronic 
documents (page 31, paragraph [0319], lines 1-7); Fig. 33, Fig. 37 and Fig. 39-41]. 

Shimizu, Newman, and Rutledge are analogous art because all three teach a 
method of configuring hypermedia. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to have combined the teachings of Rutledge with the combined 
teachings of Shimizu and Newman because Rutledge's teachings provide the 
combination of Shimizu's and Newman's method with sophisticated media search tools 
to facilitate the media search process [(page 36, paragraph [0369], lines 1-2); Fig. 39 
-Fig. 41]. 
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Furthermore, Shimizu, Newman, and Rutledge all do not explicitly teach, "the 
property editor tool is capable of configuring... hotspot properties". 

However, Efrat discloses, "the property editor tool is capable of 
configuring... hotspot properties" as [The authoring tool 1001 maybe used to define 
hotspots in media, such as video, and link 1010 the hotspots to targets (column 5, 
lines 2-3)]. 

Shimizu, Newman, Rutledge, and Efrat are analogous art because all three teach 
a method of configuring hypermedia. 

It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to have combined the teachings of Efrat with the combined 
teachings of Shimizu, Newman, and Rutledge because Efrat's teachings provide the 
combination of Shimizu's, Newman's, and Rutledge's method with the ability to create 
and display hyperlinks, or hotspots, in select regions of interest in frames of a video 
[column 2, lines 15-17]. 
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Response to Arguments 

9. Applicant's arguments filed February 6, 2008 have been fully considered but they 
are not persuasive. 

First, Applicants argue that regarding amended independent claim 1, Shimizu, 
Newman, and Rutledge do not teach, "a computer-implemented method for processing 
media and configuring program properties associated with the media for a digital 
document", "receiving user input to select the media to import using the media 
configuration tool", "importing the media selected by the user", "generating at least one 
program and one or more program properties associated with the imported media, 
wherein each program is a program object and each program property is an object, 
wherein each program object references at least one program property object", 
"creating a program element to represent each generated program, wherein each 
program element is displayed within separate program slots of the program basket 
workspace", and "editing the programs and properties based on user input obtained 
through the collection basket tool interface". 

In response, the Examiner respectfully disagrees. 

Newman discloses, "a computer-implemented method for processing media and 
configuring program properties associated with the media for a digital document" as 
[The present invention provides a complete, standalone, economical system that 
enables consumers to create, manipulate, edit, view and output hypermedia 
(column 17, lines 60-63); The term hypermedia refers to the integration of text, 
graphics, sound, video, and other data, or any combination into a primarily 
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associative system for information presentation, storage and retrieval. For 
example, hypermedia includes motion pictures, music, animation and 
photographs (column 5, lines 47-50); FIG. 12 illustrates an embodiment of a 
graphics GUI 490. The graphics GUI 490 includes a graphics tab 492 having a 
scroll bar 494 and a plurality of icons 496 representing various graphics overlays, 
such as color, titles, and text on color. The graphics GUI 490 similarly includes a 
display window 408 to display an image for graphical editing. The graphics GUI 
490 also includes an image edit window 498 having a plurality of image editing 
tool buttons 500, such as a line tool, a box tool, a text tool, cut, copy and paste, 
about the periphery of the image edit window 498... Moreover, the graphics GUI 
490 includes a features portion 502. The features portion 502 includes a name box 
504, wherein the consumer may select a name to identify the edited graphic and a 
plurality of tabs 506, each tab having property selections for some of the image 
editing tool buttons 500. For example, a color tab 508 includes selection boxes 
510 to select color features of lines, fills and shadows. Lastly, the features portion 
502 includes a pair of slider bars 512, each having a slider 514, for the selection 
of color gradients. Operation of the graphics editor is similar to conventional 
graphics editors, such as MacPaint and Paintbrush (column 16, lines 21-44); Fig. 
12]. This means that the system enables consumers to create, manipulate, edit, view 
and output hypermedia. For example, the graphics GUI allows a user to edit graphics 
included in a hypermedia. 
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Furthermore, Rutledge discloses, "receiving user input to select the media to 
import using the media configuration tool" as [The media ID software has a 
sophisticated graphical-user-interface (or GUI) that allows the user to navigate 
through the locally stored media IDs, initiate complicated search queries for local 
and remote media and media IDs, and retrieve articles of media and media IDs... 
the media ID and the media ID software contain the necessary information 
required to transfer the entire text and graphics of the original article of media 
between the web server and the media ID software 1080... when the user clicks on 
a media ID such as the one located at 1070 in FIG. 22, the entire text and graphics 
of the media article 1068 will be transferred along with the media ID 1070 to the 
media ID software 1080 (page 27, paragraph [0275], lines 1-24); The media ID 
software program manages media IDs and their content, provides advanced 
query tools for searching and sorting of media ID content, manages the download 
and transfer of media IDs and associated electronic documents, and includes 
screens, windows or other facilities for quick and easy previewing of electronic 
documents (page 31, paragraph [0319], lines 1-7); Fig. 33, Fig. 37 and Fig. 39-41]. 

Furthermore, Rutledge discloses, "importing the media selected by the user" as 
[The media ID software has a sophisticated graphical-user-interface (or GUI) that 
allows the user to navigate through the locally stored media IDs, initiate 
complicated search queries for local and remote media and media IDs, and 
retrieve articles of media and media IDs... the media ID and the media ID software 
contain the necessary information required to transfer the entire text and 
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graphics of the original article of media between the web server and the media ID 
software 1080... when the user clicks on a media ID such as the one located at 
1070 in FIG. 22, the entire text and graphics of the media article 1068 will be 
transferred along with the media ID 1070 to the media ID software 1080 (page 27, 
paragraph [0275], lines 1-24); The media ID software program manages media IDs 
and their content, provides advanced query tools for searching and sorting of 
media ID content, manages the download and transfer of media IDs and 
associated electronic documents, and includes screens, windows or other 
facilities for quick and easy previewing of electronic documents (page 31, 
paragraph [0319], lines 1-7); Fig. 33, Fig. 37 and Fig. 39-41]. 

Furthermore, Shimizu discloses, "generating at least one program and one or 
more program properties associated with the imported media" as [the hypermedia 
authoring system provides a display that permits the author to link each of the 
slot types of an instantiated document prototype with cards in a card database. 
Cards may... be created from scratch by the author or imported from external 
sources and linked with the instantiated document prototype (column 1, lines 60- 
65); The related goals outline nodes are goals outline nodes that are linked to 
cards which are also linked to spacer objects in the Bento-box 800 (column 7, 
lines 48-50); The cards in the card database 106 are information elements (called 
points) on which the document being authored is based... the cards contain the 
actual hypermedia information such as video, sound or text that make up the 
document. The contents of the points may be appropriated from either external 
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sources or created from scratch by the author (column 3, lines 38-44); Fig. 8 and 
Fig. 13]. 

Furthermore, Shimizu discloses, "each program is a program object" as [The 
cards in the card database 106 are information elements (called points) on which 
the document being authored is based... the cards contain the actual hypermedia 
information such as video, sound or text that make up the document. The 
contents of the points may be appropriated from either external sources or 
created from scratch by the author (column 3, lines 38-44); Bento-box (column 7, 
line 36); The Bento-boxes may be linked to each other in a stack for a sequential 
slide presentation (column 2, lines 12-13)]. 

Furthermore, Shimizu discloses, "each program property is an object" as [The 
spacer objects 706-718 (column 7, line 35); related goals outline nodes (column 7, 
lines 46-48); Fig. 13]. 

Furthermore, Shimizu discloses, "each program object references at least one 
program property object" as [The related goals outline nodes are goals outline 
nodes that are linked to cards which are also linked to spacer objects in the 
Bento-box 800 (column 7, lines 48-50); The cards in the card database 106 are 
information elements (called points) on which the document being authored is 
based... the cards contain the actual hypermedia information such as video, 
sound or text that make up the document. The contents of the points may be 
appropriated from either external sources or created from scratch by the author 
(column 3, lines 38-44); Fig. 8 and Fig. 13]. 
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Furthermore, Shimizu discloses, "creating a program element to represent each 
generated program, wherein each program element is displayed within separate 
program slots of the program basket workspace" as [The hypermedia authoring 
system... provides a display for creating a presentation outline in the form of 
Bento-boxes. Each Bento-box includes a layout workspace in which spacer 
objects may be placed. Spatial and temporal parameters may also be specified 
corresponding to each spacer object. The spacer objects may be linked to cards 
in the card database and an indication of a link relationship with the goals outline 
is also provided (column 1, line 66 - column 2, line 6); The cards in the card 
database 106 are information elements (called points) on which the document 
being authored is based... the cards contain the actual hypermedia information 
such as video, sound or text that make up the document. The contents of the 
points may be appropriated from either external sources or created from scratch 
by the author (column 3, lines 38-44); Bento-box 800 (which may be a card) 
(column 7, lines 36-37); The Bento-boxes may be linked to each other in a stack 
for a sequential slide presentation (column 2, lines 12-13); The cutting board 1508 
displays the presentation outline. The Bento-boxes 1510 and 1512 are shown on 
the cutting board 1508 (column 9, lines 39-42); Fig. 13 and Fig. 21]. This means that 
the program element is a card (the cards contain the actual hypermedia information 
such as video, sound or text that make up the document) or a Bento-box (which may be 
a card). 
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Finally, Shimizu discloses, "editing the programs and properties based on user 
input obtained through the collection basket tool interface" as [The hypermedia 
authoring system... provides a display for creating a presentation outline in the 
form of Bento-boxes. Each Bento-box includes a layout workspace in which 
spacer objects may be placed. Spatial and temporal parameters may also be 
specified corresponding to each spacer object. The spacer objects may be linked 
to cards in the card database and an indication of a link relationship with the 
goals outline is also provided (column 1, line 66 - column 2, line 6); Fig. 13]. 

10. Second, dependent claims 3-4, 6, and 8-12 recite similar limitations argued by 
the Applicants and are therefore also rejected for the same above reasons. 

1 1 . Third, Applicant's arguments with respect to newly added claims 19-31 have 
been fully considered but they are not persuasive. Claims 19-22 are rejected under 35 
U.S.C. 1 03(a) as being unpatentable over Shimizu et al. (US Patent 6,374,271 B1 ), and 
in view of Newman et al. (US Patent 6,154, 600), and in further view of Rutledge (USPA 
Pub 2004/0054627 A1). Furthermore, claims 23-32 are rejected under 35 U.S.C. 103(a) 
as being unpatentable over Shimizu et al. (US Patent 6,374,271 B1 ), in view of 
Newman et al. (US Patent 6,154, 600), in further view of Rutledge (USPA Pub 
2004/0054627 A1 ), and in further view of Efrat et al. (US 6,570,587 B1 ). For details see 
the rejection. 
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Conclusion 

12. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. Applicant is required under 37 C.F.R. §1.111 (c) to consider 
these references fully when responding to this action. The documents cited in form 
PTO-892 teach a method for configuring media file properties for a digital document 
using a program property configuration tool. 

1 3. The examiner requests, in response to this Office action, support be shown for 
language added to any original claims on amendment and any new claims. That is, 
indicate support for newly added claim language by specifically pointing to page(s) and 
line no(s) in the specification and/or drawing figure(s). This will assist the examiner in 
prosecuting the application. 

14. When responding to this office action, Applicant is advised to clearly point out the 
patentable novelty which he or she thinks the claims present, in view of the state of the 
art disclosed by the references cited or the objections made. He or she must also show 
how the amendments avoid such references or objections See 37 CFR 1.111 (c). 
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Contact Information 

1 5. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Michele C. Choi whose telephone number is 571-272- 
9776. The examiner can normally be reached on Mon-Fri, 7:30AM to 5PM EST, 
alternate Friday off. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Charles Rones can be reached on 571-272-4085. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for published 
applications may be obtained from either Private (PAIR) or Public PAIR. Status 
information for unpublished applications is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business 
Center (EBC) at 866-217-9197 (toll free). If you would like assistance from a USPTO 
Customer Service Representative or access to the automated information system, call 
800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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